Smartkom-home - an advanced multi-modal interface to home entertainment
نویسندگان
چکیده
This paper describes the SmartKom-Home system realized within the SmartKom project. It assists the user by means of a multi-modal dialogue system in the home environment. This involves the control of various devices and the access to services. SmartKom-Home is supposed to serve as a uniform interface to all these devices and services so the user is freed from the necessity to understand which of the devices to consult how and when to fulfill complex wishes. We describe the setting of this scenario together with the hardware used. We furthermore discuss the specific requirements that evolve in a home environment, and how they are handled in the project.
منابع مشابه
SmartKom–Home — and advanced multi-modal interface to home entertainment
This paper describes the SmartKom-Home system realized within the SmartKom project. It assists the user by means of a multi-modal dialogue system in the home environment. This involves the control of various devices and the access to services. SmartKom-Home is supposed to serve as a uniform interface to all these devices and services so the user is freed from the necessity to understand which o...
متن کاملMulti-modal Interface with Voice and Head Tracking for Multiple Home Appliances
In this paper, we describe a multi-modal interface that allows use of voice and gesture commands for controlling distributed home appliances used by people with disabilities. The main objective of this study is combined with nonverbal and verbal interface for intuitive and efficient control that uses hands-free operation. The pointing gesture by facing as nonverbal interface represents selectin...
متن کاملReal-Time and Marker-Free 3D Motion Capture for Home Entertainment Oriented Applications
We present an automated system for real-time marker-free motion capture from two calibrated webcams. For fast 3D shape and skin reconstructions, we extend Shape-From-Silhouette algorithms. The motion capture system is based on simple and fast heuristics to increase the efficiency. Multi-modal scheme using both shape and skin-parts analysis, temporal coherence, and human anthropometric constrain...
متن کاملDevelopment of the User-State Conventions for the Multimodal Corpus in SmartKom
This contribution deals with the problem of finding procedures for the labeling of a multimodal data corpus that is created within the SmartKom project. The goal of the SmartKom project is the development of an intelligent computer-user interface that allows almost natural communication with an adaptive and self-explanatory machine. The system does not only accept input in form of natural speec...
متن کاملAn Open Platform for Multimedia Entertainment Systems
Today home entertainment appliances are usually based on closed, proprietary hardware and software design supporting only a limited set of media types, stream formats, and entertainment options. With the availability of cheap, small, quiet, and powerful multimedia PCs, it is now possible to create an open and extensible PC-based platform for multimedia home entertainment. Based on a new multime...
متن کامل